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Description 

Stereoscopic Parameter Embedding Apparatus and Stereoscopic Image 

Reproducer 

5 Technical Field 
[0001] 

The present invention relates to a technique of generating 
stereoscopic images on the basis of video image data. 

1 0 Background Art 
[0002] 

A stereoscopic system in which an image for a left eye and an image 
for a right eye, having a given disparity therebeween, are combined and 
displayed is well known. A viewer wears complementary color glasses or 
15 polarized glasses, or uses a lenticular lens or a parallax barrier to partially 
block his/her vision to thereby cause binocular disparity. 
[0003] 

A set of disparity images is typically created by imaging one object 
from two different viewpoints. However, a set of disparity images can be 

20 created from one image taken from a single viewpoint, as is suggested in 
Patent Document 1 . A stereoscopic image generator described in Patent 
Document 1 calculates depth-values from saturations of pixels forming an 
image, discriminates on the basis of the depth- values (or corrected depth- 
values) between a near view and a distant view of the image, and enlarges 

25 a disparity between an image for a left eye and an image for a right eye in 
the near view than in the distant view. The algorithm of calculating a 
depth- value from saturation of a pixel is employed in view of an empirical 
rule that generally a more distant scene has a lower saturation and a nearer 
scene has a higher saturation. 
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[0004] 

Owing to techniques such as that described in Patent Document 1 , it 
has recently become relatively easy to create, from one image, images 
which have a given disparity there between. Accordingly, it is expected 
5 that video content not originally intended for stereoscopic vision will in 
future be subject to a stereoscopic imaging process and marketed in a 
computer readable medium such as a DVD (Digital Video Disc). A 
purchaser of such a DVD will be able to view the video content as 
stereoscopic images using a computer. 

10 

[0005] 

Patent Document 1 : Unexamined Patent Publication No. 2002- 
123842. 

15 Disclosure of the Invention 

Problems to be Solved by the Invention 
[0006] 

It should be noted that viewing video content as stereoscopic images 
places a heavier strain on the eyes of a viewer than does viewing the same 

20 content as normal two-dimensional images. Therefore, some users may 
wish to view video content which has been processed using stereoscopic 
imaging, simply as two-dimensional images. However, in a case where 
such stereoscopic processed video content is stored on a medium, it is not 
possible to then view such content as normal two-dimensional images. . 

25 The present invention has been made in view of the above-described 

circumstances, and provides video content which a user can view either as 
stereoscopic images or as two-dimensional images. 



Means for Solving the Problems 
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[0007] 

A computer readable medium according to a preferred embodiment 
of the present invention comprises: a plurality of pieces of video image 
data to be processed sequentially; and stereoscopic parameters for 
5 converting a video image into a stereoscopic image, each of which is 
associated with each of the plurality of pieces of video image data. 
[0008] 

A computer readable medium according to another preferred 
embodiment of the present invention comprises: a plurality of pieces of 
10 video image data to be processed sequentially; and sub-picture data to be 
combined with each of the plurality of pieces of video image data, wherein 
the sub-picture data contains stereoscopic parameters for converting a 
video image into a stereoscopic image. 
[0009] 

15 In the embodiments, the computer readable medium may further 

comprise a program for causing a computer to execute a stereoscopic 
imaging process effecting the stereoscopic parameters on the video image 
data. 
[0010] 

20 A stereoscopic parameter embedding apparatus according to another 

embodiment of the present invention comprises: a video image input unit 
operable to input a plurality of pieces of video image data to be processed 
sequentially; a parameter input unit operable to input stereoscopic 
parameters for converting a video image into a stereoscopic image, each 

25 parameter being associated respectively with each of the plurality of pieces 
of video image data; a converter operable to convert each of the input 
stereoscopic parameters into binary data; and an embedding unit operable 
to embed bar-code image data corresponding to the binary data in each of 
the plurality of pieces of video image data. 



r 
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[0011] 

A stereoscopic parameter embedding apparatus according to another 
embodiment of the present invention comprises: a sub-picture input unit 
operable to input sub-picture data to be combined with each of a plurality 
5 of pieces of video image data to be processed sequentially; a parameter 
input unit operable to input stereoscopic parameters for converting a video 
image into a stereoscopic image, each parameter being associated 
respectively with each of the plurality of pieces of video image data; a 
converter operable to convert each of the input stereoscopic parameters 
10 into binary data; and an embedding unit operable to embed bar-code image 
data corresponding to the binary data in each of the pieces of sub-picture 
data. 
[0012] 

In the embodiment, the stereoscopic parameter embedding apparatus 
15 may further comprises: a video image input unit operable to input a 

plurality of pieces of video image data to be combined with the sub-picture 
data; a video content data preparing unit operable to prepare video content 
data of signals, wherein the sub-picture data with the embedded bar-code 
image data and the video image data input via the video image input unit 
20 are multiplexed in accordance with predetermined standards. 
[0013] 

A stereoscopic image reproducer according to another embodiment 
of the present invention comprises: a reader operable to read video image 
data to be processed sequentially from a computer readable medium, the 
25 computer readable medium comprising the video image data and bar-code 
image data, the bar-code image data being prepared through conversion of 
stereoscopic parameters for converting a video image into a stereoscopic 
image, into binary data; a bar-code identifying unit operable to identify the 
bar-code image data embedded in the read video image data; a parameter 
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extracting unit operable to analyze the identified bar-code image data and 
extract the stereoscopic parameters; a stereoscopic processor operable to 
apply a stereoscopic imaging process on the video image data, the 
stereoscopic imaging process effecting the extracted stereoscopic 
5 parameters on the video image data in which the bar-code image data of 
the stereoscopic parameters is embedded; an output unit operable to output 
the stereoscopic-process-applied video image data to a display in a 
predetermined sequence. 
[0014] 

10 A stereoscopic image reproducer according to another embodiment 

of the present invention comprises: a reader operable to read video content 
data from a computer readable medium, the video content data comprising 
video image data to be processed sequentially, and sub-picture data to be 
combined with the video image data and in which bar-code image data is 

1 5 embedded, the bar-code image data being prepared through conversion of 
stereoscopic parameters for converting a video image into a stereoscopic 
image, into binary data; an extracting unit operable to extract the video 
image data and the sub-picture data from the read video content data; a 
bar-code identifying unit operable to identify the bar-code image data 

20 embedded in the extracted sub-picture data; a parameter extracting unit 
operable to analyze the identified bar-code image data and extract the 
stereoscopic parameters; a stereoscopic processor operable to apply a 
stereoscopic imaging process on the video image data, the stereoscopic 
imaging process effecting the extracted stereoscopic parameters on the 

25 video image data to be combined with the sub-picture data where the bar- 
code image data of the stereoscopic parameters is embedded; a combiner 
operable to combine the stereoscopic-process-applied video image data 
with the sub-picture data; an output unit operable to output the video 
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image data with the combined sub-picture data to a display in a 

predetermined sequence. 

[0015] 

In the embodiment, the stereoscopic image reproducer may further 
5 comprise a bar-code eraser operable to alter the sub-picture data to erase 
the bar-code image data after the bar-code data is analyzed and the 
stereoscopic parameters are extracted from the bar-code image data, 
wherein the combiner combines the video image data with the altered sub- 
picture data. 
10 [0016] 

Also, in the embodiment, the stereoscopic image reproducer may 
further comprise a reproduction system switcher operable to switch 
between reproduction of video image data for stereoscopic viewing and 
reproduction of video image data not for stereoscopic viewing, wherein the 

15 combiner, if reproduction of video image data for stereoscopic viewing is 
selected by the reproduction system switcher, combines the stereoscopic- 
process-applied video image data with the sub-picture data, and if 
reproduction of video image data not for stereoscopic viewing is selected 
by the reproduction system switcher, combines the pre-stereoscopic- 

20 process video image data with the sub-picture data. 
[0017] 

A program according to another embodiment of the present 
invention causes a computer to execute a process, the computer 
comprising: a video image input unit operable to input a plurality of pieces 
25 of video image data to be processed sequentially; and a parameter input 
unit operable to input stereoscopic parameters for converting a video 
image into a stereoscopic image, each of which is associated with each of 
the plurality of pieces of video image data, the process comprising: 
converting each of stereoscopic parameters input via the parameter input 
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unit into binary data; and embedding bar-code image data corresponding to 
the binary data in video image data input via the video image input unit. 
[0018] 

A program according to another embodiment of the present 
5 invention causes a computer to execute a process, the computer 

comprising: a sub-picture input unit operable to input sub-picture data to 
be combined with each of a plurality of pieces of video image data to be 
processed sequentially; and a parameter input unit operable to input 
stereoscopic parameters for a video image into a stereoscopic image, each 

10 parameter being associated with each of the plurality of pieces of video 
image data, the process comprising: converting each of stereoscopic 
parameters input via the parameter input unit into binary data; and 
embedding bar-code image data corresponding to the binary data in sub- 
picture data input via the sub-picture input unit. 

15 [0019] 

A program according to another embodiment of the present 
invention causes a computer to execute a process, the computer 
comprising: a reader operable to read video image data to be processed 
sequentially from a computer readable medium, the computer readable 

20 medium comprising the video image data and bar-code image data, the bar- 
code image data being prepared through conversion of stereoscopic 
parameters for converting a video image into a stereoscopic image, into 
binary data; and a display operable to display a video image, the process 
comprising: identifying bar-code image data embedded in video image 

25 data read by the reader; analyzing the identified bar-code image data to 
extract stereoscopic parameters; applying a stereoscopic imaging process 
to the video image data, the stereoscopic imaging process effecting the 
extracted stereoscopic parameters on the video image data in which the 
bar-code image data of the stereoscopic parameters is embedded; and 
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outputting the stereoscopic-process-applied video image data to the display 

in a predetermined sequence. 

[0020] 

A program according to another embodiment of the present 
5 invention causes a computer to execute a process, the computer 

comprising: a reader operable to read video content data from a computer 
readable medium, the video content data comprising video image data to 
be processed sequentially, and sub-picture data to be combined with the 
video image data and in which bar-code image data is embedded, the bar- 

10 code image data being prepared through conversion of stereoscopic 

parameters for converting a video image into a stereoscopic image, into 
binary data; and a display operable to display a video image; the process 
comprising: extracting video image data and the sub-picture data from the 
video content data read via the reader; identifying bar-code image data 

15 embedded in the extracted sub-picture data; analyzing the identified bar- 
code image data to extract stereoscopic parameters; applying a 
stereoscopic imaging process on the video image data, the stereoscopic 
imaging process effecting the extracted stereoscopic parameters on the 
video image data to be combined with the sub-picture data in which the 

20 bar-code image data of the stereoscopic parameters is embedded; 

combining the stereoscopic-process-applied video image data with the sub- 
picture data; outputting the video image data with the combined sub- 
picture data to the display in a predetermined sequence. 
[0021] 

25 A method of distributing video content data according to another 

embodiment of the present invention, comprises: generating video content 
data representing signals by a first computer comprising: a video image 
input unit operable to input a plurality of pieces of video image data to be 
processed sequentially; a sub-picture input unit operable to input sub- 
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picture data to be combined with each of the plurality of pieces of video 
image data; and a parameter input unit operable to input stereoscopic 
parameters for converting a video image into a stereoscopic image, each of 
which is associated with each of the pieces of plurality of video image 

5 data, the step of generating video content data comprising: converting 
stereoscopic parameters input from the sub-picture input unit into binary 
data; embedding bar-code image data corresponding to the binary data in 
sub-picture data input from the sub-picture input unit; and multiplexing the 
sub-picture data in which the bar-code image data is embedded and video 

10 image data input from the video image input unit in conformity with 

predetermined standards to generate the signals, storing the video content 
data in a computer readable medium and shipping it; causing the video 
content data stored in the computer readable medium to be processed by a 
second computer capable of reproducing the video content data; and 

15 displaying a stereoscopic image of a video image by the second computer, 
comprising: extracting the video image data and the sub-picture data from 
the video content data read from the computer readable medium; 
identifying the bar-code image data embedded in the extracted sub-picture 
data; analyzing the identified bar-code image data and extracting the 

20 stereoscopic parameters; applying a stereoscopic imaging process to the 
video image data, the stereoscopic imaging process effecting the extracted 
stereoscopic parameters on the video image data to be combined with the 
sub-picture data in which the bar-code image data of the stereoscopic 
parameters is embedded; combining the stereoscopic-imaging-process- 

25 applied video image data with the sub-picture data; and outputting the 
video image data with the combined sub-picture data to a display in a 
predetermined sequence. 
[0022] 
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A computer readable medium according to another embodiment of 
the present invention comprises: two-dimensional image data; and 
stereoscopic parameters for converting a two-dimensional image into a 
stereoscopic image, the stereoscopic parameters being associated with the 
5 two-dimensional image. 
[0023] 

A stereoscopic parameter embedding apparatus according to another 
embodiment of the present invention comprises: an image input unit 
operable to input two-dimensional image data; a parameter input unit 

10 operable to input stereoscopic parameters for converting a two- 
dimensional image into a stereoscopic image; a converter operable to 
convert each of the input stereoscopic parameters into binary data; and an 
embedding unit operable to embed bar-code image data corresponding to 
the binary data in the input two-dimensional image data. 

15 [0024] 

A stereoscopic image reproducer according to another embodiment 
of the present invention comprises: a reader operable to read two- 
dimensional image data from a computer readable medium, the computer 
readable medium comprising video image data in which bar-code image 

20 data is embedded, the bar-code image data being prepared through 

conversion of stereoscopic parameters for converting a two-dimensional 
image into a stereoscopic image, into binary data; a bar-code identifying 
unit operable to identify the bar-code image data embedded in the read 
two-dimensional image data; a parameter extracting unit operable to 

25 analyze the identified bar-code image data and extract the stereoscopic 
parameters; a stereoscopic processor operable to apply a stereoscopic 
imaging process to the two-dimensional image data, the stereoscopic 
imaging process effecting the extracted stereoscopic parameters on the 
two-dimensional image data in which the bar-code image data of the 
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stereoscopic parameters is embedded; an output unit operable to output the 
stereoscopic-process-applied video image data to a display in a 
predetermined sequence. 
[0025] 

5 A program according to another embodiment of the present 

invention causes a computer to execute a process, the computer 
comprising: an image input unit operable to input two-dimensional image 
data; and a parameter input unit operable to input stereoscopic parameters 
for converting a two-dimensional image into a stereoscopic image; the 
10 process comprising: converting each of stereoscopic parameters input via 
the parameter input unit into binary data; and embedding bar-code image 
data corresponding to the binary data in two-dimensional image data input 
via the video image input unit. 
[0026] 

15 A program according to another embodiment of the present 

invention causes a computer to execute a process, the computer 
comprising: a reader operable to read two-dimensional image data from a 
computer readable medium, the computer readable medium comprising the 
two-dimensional image data in which bar-code image data is embedded, 

20 the bar-code image data being prepared through conversion of stereoscopic 
parameters for converting a two-dimensional image into a stereoscopic 
image, into binary data; and a display operable to display an image, the 
process comprising: identifying bar-code image data embedded in two- 
dimensional image data read by the reader; analyzing the identified bar- 

25 code image data to extract stereoscopic parameters; applying a 

stereoscopic imaging process on the two-dimensional image data, the 
stereoscopic imaging process effecting the extracted stereoscopic 
parameters on the two-dimensional image data in which the bar-code 
image data of the stereoscopic parameters is embedded; and outputting 
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stereoscopic image data generated through the stereoscopic process to the 
display. 

Effects of the Invention 
5 [0027] 

In the present invention, video data of the video content and 
parameter data for the video content are stored separately on a computer 
medium. When it is desired to view the video content stereoscopically, the 
separately stored video parameter data are used to generate stereoscopic 
10 images from the stored video image data. Since the stereoscopic 
parameters and the video image data are stored separately, the video 
content can be reproduced to be viewed either stereoscopically or two- 
dimensionally. 

1 5 Brief Description of the Drawings 
[0028] 

Fig. 1 is a schematic diagram of a hardware configuration of a stereoscopic 
parameter embedding apparatus. 

Fig. 2 is a hardware configuration diagram of sub-picture data modifier 15. 
20 Fig. 3 is a diagram showing a sub-picture in which a bar-code image is 
embedded. 

Fig. 4 is a flowchart illustrating a data embedding process performed by 
bar-code image embedding unit 15e. 

Fig. 5 is a schematic diagram of a hardware configuration of a stereoscopic 
25 image reproducer. 

Fig. 6 is a hardware configuration diagram of a stereoscopic parameter 
extractor. 

Fig. 7 is a flowchart illustrating a process performed by a bar-code 
analyzer. 
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Explanation of the Numerals in the Figures 
[0029] 

10. . .Time reference signal supplier, 11.. .Video data encoder, 12. . .Audio 
5 data encoder, 13... Parameter memory, 14... Parameter input unit, 15... Sub- 
picture data modifier, 16. . .Sub-picture data encoder, 17. . .Multiplexer, 
20. . .Pick up unit, 21 . . .Demodulator/error corrector, 22. . .Demultiplexer, 
23 . . .Audio data decoder, 24. . .Video data decoder, 25 . . .Reproduction 
system switcher, 26. . .Stereoscopic processor, 27. . .Combiner, 28. . .Sub- 
10 picture data decoder, 29. . .Stereoscopic parameter extractor 

Best Mode for Implementing the Invention 
[0030] 

(Embodiment of the Invention) 
15 Below, an embodiment of the present invention will now be 

described. 

The present embodiment is characterized in that parameters for 
converting a two-dimensional image into a stereoscopic image are 
embedded in sub-picture data, which data are multiplexed and stored in a 
20 DVD (Digital Video Disc) for use when the DVD is played. 
[0031] 

Now, key terms used in the following description will be defined. 
The term "creator" is used to refer to an entity that creates video content 
stored on a DVD. The term "user" is used to refer to a person or company 
25 which purchases and uses a DVD on which created video content is stored. 
The term "video data" is used to refer to data embodying video signals for 
main pictures; the term "audio data" is used to refer to data embodying 
audio signals; the term "sub-picture data" is used to refer to data 
embodying video signals for a sub-picture; and the term "video content 
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data" is used to refer to data created when the foregoing 3 types of data are 

multiplexed in conformity with defined standards. 

[0032] 

A method of distributing video content data according to the present 
5 embodiment includes: a video content creation process; a DVD shipping 
process; a video content obtaining process; and a stereoscopic image 
displaying process. With regard to the description which follows of an 
embodiment of the present invention, a video content creation process and 
a stereoscopic image displaying process are characteristic. 

10 In the video content creation process, a creator obtains video data, 

audio data, and sub-picture data, as source data of video content, and 
embeds bar-code image data in the sub-picture. The bar-code image data 
represents parameters for converting a sequence of video images to be 
reproduced based on the video data into stereoscopic images. 

15 In the DVD shipping process, a creator stores in a DVD, video 

content data containing the video data, the audio data, and the sub-picture 
data in which the bar-code image data is embedded, and ships the DVD for 
marketing. 

In the video content obtaining process, a user purchases the DVD, 
20 and uses an apparatus capable of reproducing both stereoscopic images 
and two-dimensional images (hereinafter, referred to as "stereoscopic 
image reproducer") to read the video content data stored on the DVD. 

In the stereoscopic image displaying process, the user causes the 
video content data read by the stereoscopic image reproducer to be 
25 displayed as stereoscopic images. 

Each of these processes will now be described below. 

[0033] 

(Video Content Creation Process) 
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The video content creation process will now be described. The 
process is carried out by a creator using a stereoscopic parameter 
embedding apparatus. 

Fig. 1 is a block diagram showing a schematic diagram of a 
5 hardware configuration of the stereoscopic parameter embedding 
apparatus. As shown in the drawing, the apparatus includes: time 
reference signal supplier 10; video data encoder 11; audio data encoder 12; 
parameter memory 13; parameter input unit 14; sub-picture data modifier 
15; sub-picture data encoder 16; and multiplexer 17. 
10 [0034] 

Time reference signal supplier 10 supplies components of the 
parameter embedding apparatus with time reference signal t indicating a 
time that has elapsed since the beginning of reproduction of video content. 
The components of the apparatus synchronize actions for e.g. encoding of 

15 data with reference to the time reference signal t. Intervals at which the 
time reference signal t is supplied correspond to intervals at which a frame 
change of video data takes place. For example, in a case where 30 frames 
of video data are switched per second, time reference signal t is provided at 
1/30 seconds. 

20 [0035] 

In video data encoder 1 1 video data is input sequentially, and the 
encoder applies compression coding to the input video data in conformity 
with MPEG (Moving Picture Experts Group) standards. The video data 
input in video data encoder 1 1 is a sequence of sets of raster data and a 
25 time stamp. The raster data sets represent, as a bitmap, a video image for a 
respective frame; and the time stamp represents a timing of reproduction of 
the video image. 

In audio data encoder 1 2 audio data is input sequentially, and the 
encoder encodes the input audio data without compressing it. The audio 
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data input in audio data encoder 12 consists of a sequence of sets of event 
data, and a time stamp. The event data represents attributes of audio to be 
produced, and the time stamp represents a timing of processing the event 
data. 

5 The operations of video data encoder 1 1 and audio data encoder 12 

are well known from the prior art, and accordingly, detailed description 
thereof is omitted here. 
[0036] 

Parameter memory 1 3 stores sets of stereoscopic parameters with a 
10 time stamp. The stereoscopic parameters are parameters for converting a 
video image (two-dimensional image) represented by video data for each 
frame into a stereoscopic image, and consist of 1 1 different types of 
parameters, such as a depth- value (z- value) of each object drawn in a video 
image and a correction value for correcting a depth-value of an object in 
15 accordance with attributes of the object. The stereoscopic parameters 

consist of text data obtained through analysis of a video image represented 
by video data for each frame in accordance with a given algorithm, and the 
obtained stereoscopic parameters are stored in parameter memory 13 in 
association with a time stamp associated with the analyzed video image. 
20 The given algorithm is known in the prior art, and accordingly, detailed 
description thereof will be omitted. 
[0037] 

Parameter input unit 14 reads out, sequentially, a set of stereoscopic 
parameters and a time stamp from parameter memory 13, and inputs them 
25 to sub-picture data modifier 15. 
[0038] 

In sub-picture data modifier 1 5 sub-picture data is input 
sequentially, and the modifier embeds stereoscopic parameters in the input 
sub-picture data and provides the thus modified data to sub-picture data 
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encoder 16. The sub-picture data is, unlike the above-mentioned video 
data, a sequence of sets of raster data and control data. The raster data 
represent a sub-picture to be combined with a video image as a bitmap, and 
the control data represent a control method of the sub-picture. More 
5 specifically, the raster data consist of sets of attribute data of each pixel 
forming the bitmap and an address of the pixel. A pixel forming subtitles 
and a pixel forming background have different attribute data. Control data 
contain a time stamp representing the timing of starting and terminating of 
display of the sub-picture, and color codes specifying a color of subtitles 

10 and a background color. The color code is a code specifying any of 16 
colors including white (a transparent color). The control data can contain 
up to four sets of a color code and an attribute value of a pixel. For 
example, in a case where in raster data, subtitles are formed by pixels 
associated with attribute value a, and background are formed by pixels 

15 associated with attribute value b, and where in control data, attribute value 
a is associated with a color code of black, and attribute value b is 
associated with a color code of white, subtitles of the sub-picture are 
displayed in black and a background is displayed in white (a transparent 
color). In typical sub-pictures, the color of subtitles is black, and the 

20 background color is white (transparent color); however, there are some 
cases where a color code associated with a certain attribute value changes 
depending on a video image combined with the sub-picture. 
[0039] 

Fig. 2 is a block diagram showing a hardware configuration of sub- 
25 picture data modifier 15. As shown in the drawing, sub-picture data 

modifier 15 includes: data analyzer 15a; sub-picture data supplementing 
unit 15b; parameter converter 15c; binary data memory 15d; and bar-code 
image embedding unit 15e. 
[0040] 
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Data analyzer 15a distinguishes, by referring to control data 
contained in sub-picture data, between a time area where subtitles have 
been added and a time area where no subtitle has been added, and in the 
former time area, adds a new time stamp to the input sub-picture data 
5 before outputting it. Specifically, analyzer 15a updates a time stamp (a 
time stamp representing the timing of starting display and the timing of 
terminating display) contained in the control data of the sub-picture data 
with a time indicated by time reference signal t before outputting the sub- 
picture data. Accordingly, in a time area where subtitles have been added, 

10 a sequence of sub-picture data is output, wherein raster data have not been 
changed and times indicated by time stamps contained in their control data 
are successive. On the other hand, in a time area where no subtitle has 
been added, sub-picture data and a signal for instructing supplementing of 
the sub-picture data are provided to sub-picture data supplementing unit 

15 15b. 
[0041] 

Sub-picture data supplementing unit 15b, while the signal is being 
provided from data analyzer 15a to instruct supplementing sub-picture, 
generates new sub-picture data and outputs the data to bar-code image 

20 embedding unit 15e. Raster data of the new sub-picture data does not 
contain data of subtitles. A set of a color code and an attribute value 
contained in control data of the sub-picture is the same as that of sub- 
picture data provided from data analyzer 15a. A time stamp contained in 
the control data indicates the same time as that indicated by time reference 

25 signal t. Namely, in a time area where subtitles have not been added, a 
sequence of sub-picture data is output, wherein raster data does not have 
data of subtitles and times indicated by time stamps contained in their 
control data are successive. 
[0042] 
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Parameter converter 15c converts stereoscopic parameters into 
binary data. Specifically, parameter converter 15c converts a stereoscopic 
parameter into eight bits of binary data and stores the binary data in binary 
data memory 15d in association with a time stamp associated with the 
5 stereoscopic parameter. Stereoscopic parameters according to the present 
embodiment consist of 1 1 different types of parameters; accordingly, as a 
result of a single conversion, 88 bits of binary data are stored in binary 
data memory 15d. 
[0043] 

1 0 When binary data for all of 1 1 types of parameters is stored in binary 

data memory 15d, bar-code image embedding unit 15e generates bar-code 
image data corresponding to the binary data, and embeds the bar-code 
image data in raster data contained in sub-picture data provided from data 
analyzer 15a or sub-picture data supplementing unit 15b. 

15 [0044] 

Fig. 3 is a diagram showing a sub-picture where a bar-code image is 

embedded by bar-code image embedding unit 15e. 

As shown in the drawing, a bar-code image is embedded in a line of 

the third to fifth pixels from the top (hereinafter, referred to as "data 
20 embedding line") of a bitmap of a sub-picture. In the data embedding line, 

blocks of three-by-three pixels (total nines pixels) are arranged laterally. 

Each block corresponds to a bit of binary data which is binary-digitalized 

stereoscopic parameters. The color of nine pixels forming each block is 

associated with the color of either subtitles or background, and it is 
25 determined on the basis of the color of the block whether binary data 

represents "1" or "0". 

[0045] 

As shown in Fig. 3, two blocks from the left extremity L of the data 
embedding line is secured as first leading mark picture area A, and one 
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block adjoining the right side of the area A is secured as second leading 
mark picture area B. Pixels in first leading mark picture area A are all 
associated with the color of background, and pixels in second leading mark 
picture area B are all associated with the color of subtitles. The marks are 
5 not used for representing the content of binary data, which is binary- 
digitalized stereoscopic parameters, but rather are used for indicating a 
starting point of the binary data. An area adjoining the right side of second 
leading mark picture area B is secured as area C for representing the 
content of binary data. Pixels in the area C form laterally successive 88 
10 blocks, and pixels in each block are associated with the color of subtitles 
or background. 
[0046] 

Fig. 4 is a flowchart of an operation performed by bar-code image 
embedding unit 15e. 
15 At step 100, when sub-picture data is input from data analyzer 15a 

or sub-picture supplementing unit 15b, bar-code image embedding unit 15e 
refers to a time stamp contained in control data of the sub-picture data and 
reads out binary data associated with the same time stamp from binary data 
memory 15d. 

20 At step 1 10, bar-code image embedding unit 15e identifies, with 

reference to the control data of the input sub-picture data, color codes 
specifying the color of subtitles and the color of background. At step 120, 
bar-code image embedding unit 15e specifies left extremity L of a data 
embedding line of a bitmap represented by raster data contained in the sub- 

25 picture data. 

At step 130, bar-code image embedding unit 15e specifies an area of 
two blocks laterally from left extremity L as first leading mark picture area 
A, and assigns to all pixels in the specified area, an attribute value 
corresponding to the color code of the color of background identified at 
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step 1 10. For example, if the color code of the color of background 
indicates white (a transparent color), an attribute value representing white 
(a transparent color) is assigned to the pixels. 
[0047] 

5 At step 140, bar-code image embedding unit 15e specifies an area of 

one block adjoining the right side of the first leading mark picture area as 
second leading mark picture area B, and assigns to all pixels in the 
specified area, an attribute value corresponding to the color code of the 
color of subtitles identified at step 110. For example, if the color code of 

10 the color of subtitles indicates black, an attribute value representing black 
is assigned to the pixels, and if the color code indicates blue, an attribute 
value representing blue is assigned. 

At step 150, bar-code image embedding unit 15e divides pixels in an 
area adjoining the right side of second leading mark picture area B into 

15 blocks, and assigns to pixels in each block, an attribute value 

corresponding to the color code of either subtitles or background identified 
at step 1 10. Which attribute is assigned to the pixels is decided on the 
basis of the binary data read at step 100. For example, if the first piece of 
the binary data read at step 100 represents "1", an attribute value 

20 corresponding to the color code of the color of subtitles is assigned to nine 
pixels in a block adjoining on the right side of the second leading mark 
picture area. On the other hand, if the first piece of the binary data read at 
step 1 00 represents "0", an attribute value corresponding to the color code 
of the color of background is assigned. Bar-code image embedding unit 

25 1 5e refers to subsequent pieces of the binary data also, and assigns an 
attribute value to pixels in a block corresponding to each piece of the 
binary data in a similar manner. When assignment of an attribute value to 
pixels in blocks corresponding to all pieces of binary data is completed, at 
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step 160 bar-code image embedding unit 15e outputs the sub-picture data 
processed as described above to sup-picture data encoder 16. 

Bar-code image embedding unit 15e performs the operation as 
described above each time sub-picture data is input from data analyzer 15a 
5 or sub-picture supplementing unit 1 5b, 
[0048] 

Returning to description of Fig. 1, sub-picture data encoder 16 
applies a variable length coding on sub-picture data input from sub-picture 
data modifier 15. 

10 Multiplexer 17 multiplexes code strings output from video data 

encoder 11, audio data encoder 12, and sub-picture data encoder 16 to 
generate video content data which is a signal string conforming to DVD 
standards. 
[0049] 

1 5 (DVD Shipping Process) 

In the present process, the generated video content data is provided 
to a DVD manufacturing factory, and DVDs storing the video content data 
are shipped from the factory into the market. 
[0050] 

20 (Video Content Obtaining Process) 

In the present process, a user owing a stereoscopic image reproducer 
purchases a DVD in the shop, and inserts the DVD into the DVD drive of 
the stereoscopic image reproducer. 
[0051] 

25 (Stereoscopic Image Displaying Process) 

The stereoscopic image displaying process is an operation 
performed by the stereoscopic image reproducer. When the user inserts the 
DVD into the DVD drive of the stereoscopic image reproducer, selects a 
reproduction system between a stereoscopic image reproduction mode and 
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a two-dimensional image reproduction mode using a reproduction system 
selector (not shown), and instructs start of play of the DVD, the 
stereoscopic image displaying process is started. 
[0052] 

5 Fig. 5 is a schematic block diagram of a hardware configuration of 

the stereoscopic image reproducer. As shown in the drawing, the 
stereoscopic image reproducer includes: pick up unit 20; 
demodulator/error corrector 21; demultiplexer 22; audio data decoder 23; 
video data decoder 24; reproduction system switcher 25; stereoscopic 
10 processor 26; sub-picture decoder 28; stereoscopic parameter extractor 29; 
and combiner 27. 
[0053] 

An outline of an operation of the stereoscopic image reproducer is as 
follows. 

15 The video content data stored in the DVD inserted into the DVD 

drive is picked up by pick up unit 20. An output from pick up unit 20 is 
demodulated by demodulator/error corrector 21, and input to demultiplexer 
22. Demultiplexer 22 divides the video content data input from pick up 
unit 20 into compression-coded signals of audio data, video data, and sub- 

20 picture data, and provides the compression-coded signals of audio data to 
audio data decoder 23, the compression-coded signals of video data to 
video data decoder 24, and the compression-coded signals of sub-picture 
data to sub-picture data decoder 28. 
[0054] 

25 The compression-coded signals of audio data are decoded by audio 

data decoder 23 and provided to a speaker. Specifically, the compression- 
coded signals are decoded into audio data containing sets of event data 
representing attributes of audio to be produced and a time stamp 
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representing the timing of processing the event data, and provided to the 

speaker. 

[0055] 

The compression-coded signals of video data are decoded by video 
5 data decoder 24 and provided to reproduction system switcher 25. 

Specifically, the compression-coded signals are decoded into video data 
containing raster data representing a video image and a time stamp 
representing the timing of reproducing the video image, and provided to 
reproduction system switcher 25. Reproduction system switcher 25 

10 outputs the provided video data to stereoscopic processor 26 or directly to 
combiner 27. The path of the video data is switched in accordance with a 
reproduction system pre-selected by the reproduction system selector (not 
shown). Specifically, if the stereoscopic image reproduction mode is pre- 
selected, the video data is output to stereoscopic image processor 26, and if 

15 the two-dimensional image reproduction mode is pre-selected, the video 
data is output directly to combiner 27. 
[0056] 

Stereoscopic processor 26, when the video data is input from 
reproduction system switcher 25, applies a stereoscopic imaging process 

20 on the video data using stereoscopic parameters provided from 

stereoscopic parameter extractor 29. Specifically, stereoscopic processor 
26 generates an image for a left eye and an image for a right eye, which 
have a given disparity therebetween, on the basis of depth- values included 
in the stereoscopic parameters and their correction values, and combines 

25 the disparity images. The stereoscopic-imaging-process-applied video data 
is provided to combiner 27. 
[0057] 

The compression-coded signals of sub-picture data are decoded by 
sub-picture decoder 28 and provided to stereoscopic parameter extractor 
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29. Specifically, the compression-coded signals are decoded into sub- 
picture data containing sets of raster data representing a sub-picture in 
which a bar-code image is embedded and control data of the sub-picture, 
and provided to stereoscopic parameter extractor 29. The control data may 
5 contain color codes specifying a color of subtitles and a background color, 
and a time stamp for associating the sub-picture and corresponding video 
data. The stereoscopic parameter extractor 29 extracts stereoscopic 
parameters from the input sub-picture data and provides them to 
stereoscopic processor 26, and provides the sub-picture data to combiner 
10 27. 

[0058] 

Combiner 27 combines the video data input from reproduction 
system switcher 25 or stereoscopic processor 26 with the sub-picture data 
input from stereoscopic parameter extractor 29, and provides the resultant 
1 5 data to a monitor. 

The above is an outline of components of the stereoscopic image 
reproducer. Below, operation of stereoscopic parameter extractor 29, 
which performs a characteristic operation of the present embodiment, will 
now be described in detail. 
20 [0059] 

Fig. 6 is a block diagram showing a detailed hardware configuration 
of stereoscopic parameter extractor 29. As shown in the drawing, 
stereoscopic parameter extractor 29 includes: sub-picture developing 
memory 29a; bar-code reader 29b; RGB value memory 29c; bar-code 
25 eraser 29e; bar-code analyzer 29f; binary data memory 29g; and parameter 
decoder 29h. 
[0060] 

In sub-picture developing memory 29a a sub-picture represented by 
the raster data contained in the sub-picture data is developed as a bitmap. 
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In the data embedding line located at the top of the developed bitmap, a 

bar-code image is drawn, as shown in Fig. 3. 

[0061] 

Bar-code reader 29b reads data of the bar-code image from the 
5 bitmap developed in sub-picture developing memory 29a, and stores RGB 
values corresponding to the data of the bar-code image in RGB value 
memory 29c. Specifically, bar-code reader 29b performs an operation as 
described below. 

Bar-code reader 29b identifies a starting point of the bar-code image 

10 on the bitmap developed in sub-picture developing memory 29b. As 

described above with reference to Fig. 3, pixels in two blocks from the left 
extremity of the data embedding line, which are first leading mark picture 
area A, are drawn in the background color, and pixels in one block 
adjoining the right side of first leading mark picture area A, which is 

15 second leading mark picture area B, are drawn in the color of subtitles. 

Accordingly, bar-code reader 29b identifies the data embedding line (a line 
of the third to fifth pixels from the top), and refers to pixels in a direction 
towards the right from the left extremity L. When identifying pixels of a 
block (three pixels) not having the background color, bar-code reader 29b 

20 identifies the right edge of the block as the starting point of the bar-code 
image. Bar-code reader 29b reads pixels of the data embedding line 
optically from the identified starting point, and stores an RGB value in 
RGB value memory 29c in association with the address of each pixel. The 
RGB value is evaluated in 255 tones for each of R (Red), G (Green), and B 

25 (Blue). As an RGB value of a pixel becomes closer to RGB (0, 0, 0), the 
color of the pixel becomes closer to white, and as an RGB value of a pixel 
becomes closer to RGB (255, 255, 255), the color of the pixel becomes 
closer to black. 
[0062] 
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Bar-code eraser 29e, after bar-code reader 29b completes the storage 
of RGB values of pixels in RGB value memory 29c, modifies the raster 
data contained in the sub-picture data to erase the bar-code image from the 
data embedding line. Specifically, bar-code eraser 29e writes attribute 
5 values of three lines under the data embedding line (a line of the sixth to 
eighth pixels from the top) over attribute values in the data embedding 
line. The thus modified sub-picture data is provided to combiner 27. 
[0063] 

Bar-code analyzer 29f generates binary data from the RGB values of 
10 pixels stored in RGB memory 29c, and stores the generated binary data in 
binary data memory 29g. 
[0064] 

Fig. 7 is a flowchart of an operation performed by bar-code analyzer 

29f. 

15 At step 200, bar-code analyzer 29f divides the RGB values stored in 

RGB value memory 29c into groups for each block of nine pixels. Of 
these groups, the group of pixels closest to the starting point of the bar- 
code image is the first to be subjected to a subsequent process. 

At step 210, bar-code analyzer 29f selects one group and discards, 

20 from among RGB values of pixels belonging to the group, an RGB value 
closest to white (0, 0, 0) and an RGB value closest to black (255, 255, 
255). 
[0065] 

At step 220, bar-code analyzer 29f determines whether, of the 
25 remaining seven RGB values, there are more RGB values larger than a 
predetermined threshold than RGB values smaller than the threshold, or 
vice versa. The threshold depends on a color code associated with pixels 
forming subtitles in a control code contained in sub-picture data. For 
example, in a case where an attribute value of pixels forming subtitles is 
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associated with a color code of black, the threshold is set to 64, which is 
the average of an RGB value. Bar-code analyzer 29f calculates the 
average of an R value, a G value, and a B value for each of the seven 
pixels, and determines whether, of the calculated values, there are more 
5 values larger than 64 than values smaller than 64, or vice versa. In a case 
where an attribute value of pixels forming subtitles is associated with a 
color code of blue, the threshold is set to 64 and is considered against only 
a B value of a pixel. Bar-code analyzer 29f determines whether of the 
seven B values there are more B values larger than 64 than B values 
10 smaller than 64, or vice versa. 
[0066] 

If there are more RGB values larger than the threshold, at step 230 
bar-code analyzer 29f determines that the pixels of the group being 
processed correspond to "1" and stores binary data representing "1" in 
1 5 binary data memory 29g. 

On the other hand, if there are more RGB values larger than the 
threshold, at step 240 bar-code analyzer 29f determines that the pixels of 
the group in process correspond to "0" and stores binary data representing 
"0" in binary data memory 29g. 
20 [0067] 

After storing the binary data, bar-code analyzer 29f proceeds to 
select a group of pixels forming a subsequent block and to apply the 
operation from step 210 through step 240 to the group. The operation from 
step 210 through step 240 is repeated until binary data corresponding to all 
25 blocks are stored. 

In binary data memory 29g binary data ("1" or "0") output from bar- 
code analyzer 29f are stored sequentially. When the above operation is 
performed by bar-code analyzer 29f, a total of 88 pieces of binary data are 
generated from data of one sub-picture, and the sequence of binary data is 
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stored in binary data memory 29g. For example, a sequence of binary data 
corresponding to the first eight blocks from the starting point of the bar- 
code shown in Fig. 3 is "01 1 10010". On the basis of eight successive 
pieces of binary data, a parameter is decoded, as described above. 
5 [0068] 

Returning to description of Fig. 6, when binary data corresponding 
to all blocks are stored in the binary data memory, parameter decoder 29h 
reads binary data from binary data memory 29g in chronological order, 
starting with the earliest, and decodes eight pieces of binary data at a time. 

10 Namely, parameter decoder 29h converts eight successive pieces of binary 
data into text to obtain the original parameters. Parameter decoder 29h 
provides the restored parameters to stereoscopic processor 26. 
Stereoscopic processor 26 effects the parameters on video data provided 
from video data decoder 24 as a stereoscopic imaging process. 

15 [0069] 

In the present embodiment, in the video content creation process, a 
creator obtains video data, audio data, and sub-picture data, which are 
source data of video content data to be stored in a DVD, and by analysis of 
video images of the video data, obtains stereoscopic parameters for 

20 converting the video images to stereoscopic images. The creator embeds 
the stereoscopic parameters in the sub-picture data and multiplexes the 
pieces of data to generate video content data. In the stereoscopic image 
displaying process, a user selects a reproduction system between the 
stereoscopic image reproduction mode and the two-dimensional image 

25 reproduction mode, and instructs playing of the DVD. In a case where the 
stereoscopic image reproduction mode is selected, a stereoscopic image 
reproducer identifies the bar-code image embedded in the sub-picture data, 
applies a stereoscopic imaging process to the video data using parameters 
restored from the bar-code image, and causes combiner 27 to output the 
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resultant video data. In a case where the two-dimensional image 
reproduction mode is selected, the stereoscopic image reproducer causes 
combiner 27 to output the video data without applying the stereoscopic 
imaging process to it. 
5 As described above, since video data and stereoscopic parameters 

for generating stereoscopic images on the basis of the video data are 
contained separately in video content data, the video content data can be 
reproduced to be viewed either stereoscopically or two-dimensionally. 
[0070] 

10 Also, in the present embodiment, stereoscopic parameters are 

converted into binary data and embedded in sub-picture data as a bar-code 
image where a bit of binary data is expressed in nine pixels. The bar-code 
image is read optically by a stereoscopic image reproducer, and the 
stereoscopic parameters are restored from the read bar-code image. 

15 Accordingly, the stereoscopic parameters can be reproduced with great 
accuracy. 
[0071] 

Also, in the present embodiment, a stereoscopic parameter 
embedding apparatus, when embedding bar-code image data in sub-picture 

20 data, identifies the colors of subtitles and background with reference to 
control data contained in the sub-picture data, and embeds a bar-code 
image in accordance with the identified colors. Consequently, the color of 
subtitles of a sub-picture is always the same as that of the bar-code image 
embedded in the sub-picture data. Accordingly, a problem can be avoided 

25 that a change of the color of subtitles makes the recognition rate of a bar- 
code image low. 
[0072] 

(Other Embodiments) 
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The invention of the present application can be modified in various 

ways. 

In the above embodiment, video images represented by video data 
are analyzed to obtain stereoscopic parameters, and bar-code image data 
5 corresponding to the stereoscopic parameters is embedded in sub-picture 
data. However, the bar-code image data may be embedded in the video 
data. If the bar-code image data is embedded in the video data, the 
stereoscopic parameters restored from the bar-code image data and video 
data can be matched with a high degree of accuracy. 

10 The present modification is useful for storing video content data in a 

medium such as a video tape which is not capable of storing multiple types 
of data, unlike a DVD. If bar-code image data is embedded in video data, 
images can be viewed via such a medium either stereoscopically or two- 
dimensionally, as in the above embodiment. 

15 [0073] 

In the above, embodiment, generated video content data is shipped 
for marketing in DVD format. However, the video content data may also 
be distributed via a network for a fee. 
[0074] 

20 In the stereoscopic parameter embedding apparatus according to the 

above embodiment, video content data is generated by hardware logic. 
However, a stereoscopic parameter embedding program for realizing 
functions of components shown in Fig. 1, namely, time reference signal 
supplier 10; video data encoder 11; audio data encoder 12; parameter input 

25 unit 14; sub-picture data modifier 15; sub-picture data encoder 16; and 

multiplexer 1 7 may be provided in a personal computer to cause a CPU of 
the computer to execute the same operations as those of the components. 

Similarly, a stereoscopic image reproduction program for realizing 
functions of components shown in Fig. 5, namely, demultiplexer 22; audio 
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data decoder 23; video data decoder 24; reproduction system switcher 25; 
stereoscopic processor 26; sub-picture decoder 28; stereoscopic parameter 
extractor 29; and combiner 27 may be provided in a personal computer to 
cause a CPU of the computer to execute the same operations as those of 
5 the components. 
[0075] 

The stereoscopic image reproduction program may be stored in 
DVD format together with video content data in the video content creation 
process of the above embodiment, and shipped for marketing. Storage of 
10 the stereoscopic image reproduction program in DVD format enables a 
personal computer not having the program already installed to install it 
automatically and play the DVD in the stereoscopic image displaying 
mode. 
[0076] 

1 5 In the above embodiment, moving picture data such as MPEG data 

is subject to a stereoscopic imaging process. However, two-dimensional 
static image data such as JPEG (Joint Photographic Experts Group) data 
and GIF (Graphic Interchange Format) data may be subjected to the 
stereoscopic imaging process. In this case, the static image data is 

20 analyzed to obtain stereoscopic parameters, and a bar-code image 

corresponding to the parameters is embedded in the static image data. 



